Goto

Collaborating Authors

 East Dunbartonshire


Generating image captions with external encyclopedic knowledge

Nikiforova, Sofia, Deoskar, Tejaswini, Paperno, Denis, Winter, Yoad

arXiv.org Artificial Intelligence

Accurately reporting what objects are depicted in an image is largely a solved problem in automatic caption generation. The next big challenge on the way to truly humanlike captioning is being able to incorporate the context of the image and related real world knowledge. We tackle this challenge by creating an end-to-end caption generation system that makes extensive use of image-specific encyclopedic data. Our approach includes a novel way of using image location to identify relevant open-domain facts in an external knowledge base, with their subsequent integration into the captioning pipeline at both the encoding and decoding stages. Our system is trained and tested on a new dataset with naturally produced knowledge-rich captions, and achieves significant improvements over multiple baselines. We empirically demonstrate that our approach is effective for generating contextualized captions with encyclopedic knowledge that is both factually accurate and relevant to the image.


Gay men convicted of now-abolished sex offences to be pardoned

BBC News

Thousands of gay and bisexual men convicted of now-abolished sexual offences are to receive posthumous pardons, the government has announced. It will mean formal pardons for those convicted over consensual same-sex relationships before homosexuality was decriminalised in the UK. Justice Minister Sam Gyimah said the move was "hugely important". It honours a government commitment made after World War Two code-breaker Alan Turing was pardoned in 2013. Under the move - dubbed "Turing law" - deceased people who were convicted of sexual acts that are no longer deemed criminal will receive an automatic pardon.